Skip to main content

Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.

More right-solid
More right-solid
More right-solid
More right-solid
SHOW DETAILS
up-solid down-solid
Prior Page
eye
Title
Date Archived
Creator
bbc.co.uk
collection
295
ITEMS
8M
VIEWS
by http://bbc.co.uk
collection
eye 8M
cbc.ca
collection
653
ITEMS
8M
VIEWS
by http://cbc.ca/news/
collection
eye 8M
blogspot.in
collection
185
ITEMS
7.9M
VIEWS
by blogspot.in
collection
eye 7.9M
salon.com
collection
1,370
ITEMS
7.9M
VIEWS
by http://salon.com/
collection
eye 7.9M
youtube.com
collection
136
ITEMS
7.7M
VIEWS
by http://youtube.com
collection
eye 7.7M
washingtonpost.com
collection
687
ITEMS
7.6M
VIEWS
by http://washingtonpost.com/
collection
eye 7.6M
flickr.com
collection
1,274
ITEMS
7.5M
VIEWS
by http://flickr.com
collection
eye 7.5M
welt.de
collection
994
ITEMS
7.2M
VIEWS
by http://welt.de/
collection
eye 7.2M
reddit.com
collection
253
ITEMS
7.2M
VIEWS
by http://reddit.com
collection
eye 7.2M
cnn.com
collection
357
ITEMS
7.2M
VIEWS
by http://cnn.com
collection
eye 7.2M
dr1.com
collection
120
ITEMS
6.4M
VIEWS
by http://dr1.com/
collection
eye 6.4M
liveinternet.ru
collection
518
ITEMS
6.4M
VIEWS
by liveinternet.ru
collection
eye 6.4M
answers.com
collection
84
ITEMS
6.3M
VIEWS
by answers.com
collection
eye 6.3M
theguardian.com
collection
793
ITEMS
6.2M
VIEWS
by theguardian.com
collection
eye 6.2M
npr.org
collection
2,868
ITEMS
6.2M
VIEWS
by http://npr.org/
collection
eye 6.2M
top_domains-02250
web
eye 6.2M
favorite 0
comment 0
Source: top_domains-02250
espn.go.com
collection
1,322
ITEMS
6.1M
VIEWS
by http://espn.go.com
collection
eye 6.1M
xhamster.com
collection
755
ITEMS
6.1M
VIEWS
by http://xhamster.com
collection
eye 6.1M
pbs.org
collection
4,431
ITEMS
6M
VIEWS
by http://pbs.org/newshour/
collection
eye 6M
edition.cnn.com
collection
303
ITEMS
5.9M
VIEWS
by http://edition.cnn.com/
collection
eye 5.9M
xnxx.com
collection
1,642
ITEMS
5.7M
VIEWS
by http://xnxx.com
collection
eye 5.7M
msnbc.msn.com
collection
5,675
ITEMS
5.7M
VIEWS
by http://msnbc.msn.com/
collection
eye 5.7M
usatoday.com
collection
768
ITEMS
5.6M
VIEWS
by http://usatoday.com
collection
eye 5.6M
reuters.com
collection
363
ITEMS
5.6M
VIEWS
by http://reuters.com
collection
eye 5.6M
top_domains-02250
web
eye 5.6M
favorite 0
comment 0
Source: top_domains-02250
ameblo.jp
collection
95
ITEMS
5.5M
VIEWS
by http://ameblo.jp
collection
eye 5.5M
google.com
collection
109
ITEMS
5.4M
VIEWS
by http://google.com
collection
eye 5.4M
livejournal.com
collection
110
ITEMS
5.3M
VIEWS
by http://livejournal.com
collection
eye 5.3M
seattlepi.com
collection
1,382
ITEMS
5.3M
VIEWS
by http://www.seattlepi.com/
collection
eye 5.3M
top_domains-00400
web
eye 5.2M
favorite 0
comment 0
Source: top_domains-00400
newsweek.com
collection
394
ITEMS
5.2M
VIEWS
by http://newsweek.com/
collection
eye 5.2M
abcnews.go.com
collection
1,349
ITEMS
5.2M
VIEWS
by http://abcnews.go.com/
collection
eye 5.2M
pornhub.com
collection
1,053
ITEMS
5.2M
VIEWS
by http://pornhub.com
collection
eye 5.2M
ehow.com
collection
253
ITEMS
5.1M
VIEWS
by ehow.com
collection
eye 5.1M
us.cnn.com
collection
286
ITEMS
5.1M
VIEWS
by http://us.cnn.com/
collection
eye 5.1M
thecostaricanews.com
collection
113
ITEMS
5.1M
VIEWS
by http://thecostaricanews.com/
collection
eye 5.1M
imgur.com
collection
447
ITEMS
4.9M
VIEWS
by http://imgur.com
collection
eye 4.9M
dailymotion.com
collection
5,165
ITEMS
4.9M
VIEWS
by http://dailymotion.com
collection
eye 4.9M
telegraph.co.uk
collection
150
ITEMS
4.8M
VIEWS
by http://telegraph.co.uk
collection
eye 4.8M
weather.com
collection
462
ITEMS
4.7M
VIEWS
by http://weather.com/
collection
eye 4.7M
elmundo.es
collection
337
ITEMS
4.6M
VIEWS
by http://elmundo.es/
collection
eye 4.6M
kp.ru
collection
434
ITEMS
4.5M
VIEWS
by http://kp.ru/
collection
eye 4.5M
asahi.com
collection
292
ITEMS
4.5M
VIEWS
by http://www.asahi.com/
collection
eye 4.5M
wunderground.com
collection
249
ITEMS
4.4M
VIEWS
by http://wunderground.com/
collection
eye 4.4M
msn.com
collection
583
ITEMS
4.4M
VIEWS
by http://msn.com
collection
eye 4.4M
sharelive.net
collection
8
ITEMS
4.3M
VIEWS
by sharelive.net
collection
eye 4.3M
nesdis.noaa.gov
collection
13
ITEMS
4.3M
VIEWS
by https://www.nesdis.noaa.gov
collection
eye 4.3M
sharelive.net
web
eye 4.2M
favorite 0
comment 0
Source: sharelive.net
rfi.fr
collection
2,488
ITEMS
4.1M
VIEWS
by http://rfi.fr/
collection
eye 4.1M
chinadigitaltimes.net
collection
359
ITEMS
4.1M
VIEWS
by http://chinadigitaltimes.net/
collection
eye 4.1M
macleans.ca
collection
249
ITEMS
4.1M
VIEWS
by http://macleans.ca/
collection
eye 4.1M
wordpress.com
collection
790
ITEMS
4.1M
VIEWS
by http://wordpress.com
collection
eye 4.1M
gulfnews.com
collection
298
ITEMS
4M
VIEWS
by http://gulfnews.com/
collection
eye 4M
nesdis.noaa.gov
web
eye 3.9M
favorite 0
comment 0
Source: nesdis.noaa.gov
sourceforge.net
collection
125
ITEMS
3.9M
VIEWS
by sourceforge.net
collection
eye 3.9M
top_domains-01000
web
eye 3.9M
favorite 0
comment 0
Source: top_domains-01000
soundcloud.com
collection
165
ITEMS
3.8M
VIEWS
by soundcloud.com
collection
eye 3.8M
google.ru
collection
46
ITEMS
3.8M
VIEWS
by http://google.ru
collection
eye 3.8M
dailymail.co.uk
collection
310
ITEMS
3.7M
VIEWS
by http://dailymail.co.uk/
collection
eye 3.7M
google.com.br
collection
39
ITEMS
3.7M
VIEWS
by http://google.com.br
collection
eye 3.7M
youporn.com
collection
2,085
ITEMS
3.7M
VIEWS
by http://youporn.com
collection
eye 3.7M
globalvoicesonline.org
collection
111
ITEMS
3.7M
VIEWS
by http://globalvoicesonline.org
collection
eye 3.7M
propublica.org
collection
538
ITEMS
3.7M
VIEWS
by http://propublica.org/
collection
eye 3.7M
ask.com
collection
44
ITEMS
3.7M
VIEWS
by http://ask.com
collection
eye 3.7M
cbsnews.com
collection
630
ITEMS
3.6M
VIEWS
by http://cbsnews.com
collection
eye 3.6M
wsj.com
collection
396
ITEMS
3.6M
VIEWS
by http://wsj.com
collection
eye 3.6M
theglobeandmail.com
collection
175
ITEMS
3.6M
VIEWS
by http://theglobeandmail.com/
collection
eye 3.6M
theweek.com
collection
857
ITEMS
3.6M
VIEWS
by http://theweek.com
collection
eye 3.6M
google.es
collection
44
ITEMS
3.6M
VIEWS
by http://google.es
collection
eye 3.6M
google.com.tr
collection
44
ITEMS
3.5M
VIEWS
by http://google.com.tr
collection
eye 3.5M
europe.wsj.com
collection
412
ITEMS
3.5M
VIEWS
by http://europe.wsj.com/
collection
eye 3.5M
google.co.uk
collection
47
ITEMS
3.5M
VIEWS
by http://google.co.uk
collection
eye 3.5M
lastampa.it
collection
233
ITEMS
3.5M
VIEWS
by http://lastampa.it/redazione/default.asp
collection
eye 3.5M
slate.com
collection
992
ITEMS
3.5M
VIEWS
by http://slate.com/
collection
eye 3.5M
redtube.com
collection
1,286
ITEMS
3.4M
VIEWS
by http://redtube.com
collection
eye 3.4M